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?3 ' Abstract 

We investigate tlie incremental stability properties of Ito stochastic 
dynamical systems. Specifically, we derive a stochastic version of non- 
04 ' linear contraction theory that provides a bound on the mean square 

distance between any two trajectories of a stochastically contracting 
system. This bound can be expressed as a function of the noise inten- 
, sity and the contraction rate of the noise-free system. We illustrate 

■ these results in the contexts of stochastic nonlinear observers design 
, and stochastic synchronization. 

o 

O ■ 1 Introduction 



> 
(N 



Nonlinear stability properties are often considered with respect to an equi 



librium point or to a nominal system trajectory (see e.g. [3l|])- By contrast, 
' incremental stability is concerned with the behaviour of system trajectories 

with respect to each other. From the triangle inequality, global exponential 
incremental stability (any two trajectories tend to each other exponentially) 
is a stronger property than global exponential convergence to a single tra- 
jectory. 

Historically, work on deterministic incremental stability can be traced 
back to the 1950's 0, 0, EgI (see e.g. (26l . [2o| for a more extensive list and 
historical discussion of related references). More recently, and largely inde- 
pendently of these earlier studies, a number of works have put incremental 
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stability on a broader theoretical basis and made relations with more tradi- 
tional stability approaches [13) El, 05 0] • Furthermore, it was shown that 
incremental stability is especially relevant in the study of such problems as 
state detection [3], observer design or synchronization analysis. 

While the above references are mostly concerned with deterministic sta- 
bility notions, stability theory has also been extended to stochastic dynam- 
ical systems, see for instance [j^ . [l7| . This includes important recent de- 



velopments in Lyapunov-like approaches l27l]. a s well as applications to 
standard problems in systems and controljlsT 34 . However, stochastic 
versions of incremental stability have not yet been systematically investi- 
gated. 

The goal of this paper is to extend some concepts and results in in- 
cremental stability to stochastic dynamical systems. More specifically, we 
derive a stochastic version of contraction analysis in the specialized context 
of state-independent metrics. 

We prove in section [2] that the mean square distance between any two 
trajectories of a stochastically contracting system is upper-bounded by a 
constant after exponential transients. In contrast with previous works on 
incremental stochastic stability [sj], we consider the case when the two tra- 
jectories are subject to distinct and independent noises, as detailed in sec- 
tion 12.2.11 This specificity enables our theory to have a number of new and 
practically important applications. However, the fact that the noise does 
not vanish as two trajectories get very close to each other will prevent us 
from obtaining asymptotic almost-sure stability results (see section I2.3.2p . 

In section [3l we show that results on combinations of deterministic con- 
tracting systems have simple analogues in the stochastic case. These combi- 
nation properties allow one to build by recursion stochastically contracting 
systems of arbitrary size. 

Finally, as illustrations of our results, we study in section [3] several ex- 
amples, including contracting observers with noisy measurements, stochas- 
tic composite variables and synchronization phenomena in networks of noisy 
dynamical systems. 

2 Main results 
2.1 Background 

2.1.1 Nonlinear contraction theory 

Contraction theory |2^] provides a set of tools to analyze the incremental 
exponential stability of nonlinear systems, and has been applied notably 
to observer design \24 . 

aaaja, synchronization analysis 0,0 and 



systems neuroscience modelling [l5|. Nonlinear contracting systems enjoy 
desirable aggregation properties, in that contraction is preserved under many 
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types of system combinations given suitable simple conditions [2J]. 

While we shall derive global properties of nonlinear systems, many of our 
results can be expressed in terms of eigenvalues of symmetric matrices [l9| . 
Given a square matrix A, the symmetric part of A is denoted by A^. The 
smallest and largest eigenvalues of A^ are denoted by Amin(A) and Amax(A). 
Given these notations, the matrix A is positive definite (denoted A > 0) if 
Amin(A) > 0, and it is uniformly positive definite if 

3/3 > Vx, t Amin(A(x, t)) > P 



The basic theorem of contraction analysis, derived in 2j], can be stated 
as follows 

Theorem 1 (Contraction) Consider, in M", the deterministic system 

?c = f(x,t) (2.1) 

where i is a smooth nonlinear function. Denote the Jacobian matrix of f 
with respect to its first variable by If there exists a square matrix 0(x, t) 
such that M(x, t) = 0(x, t)^0(x, t) is uniformly positive definite and the 
matrix 

F(x,t) = (^|0(x,t) + 0(x,O^) 0-Hx,t) 

is uniformly negative definite, then all system trajectories converge exponen- 
tially to a single trajectory, with convergence rate \ sup^ t Amax(F)| = A > 0. 
The system is said to be contracting, F is called its generalized Jacobian, 
M(x, t) its contraction metric and A its contraction rate. 

2.1.2 Standard stochastic stability 

In this section, we present very informally the basic ideas of standard stochas- 



tic stability (for a rigourous treatment, the reader is referred to e.g. 22]). 
This will set the context to understand the forthcoming difficulties and dif- 
ferences associated with incremental stochastic stability. 

For simplicity, we consider the special case of global exponential stability. 
Let x{t) be a Markov stochastic process and assume that there exists a non- 
negative function V {V{x.) may represent e.g. the squared distance of x 
from the origin) such that 

Vx G AV{x) < -XV{x) (2.2) 

where A is a positive real number and A is the infinitesimal operator of the 
process x(t). The operator A is the stochastic analogue of the deterministic 
differentiation operator. In the case that x(t) is an Ito process, A corre- 
sponds to the widely- used [27, sl, 1] differential generator ^ (for a proof of 



this fact, see [23], p. 15 or [3|], p. 42). 
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For xo G M", let Exo(-) = IE(-|x(0) = xq). Then by Dynkin's formula 



([23], p. 10), one has 



Vt>0 Exol^(x(t)) - F(xo) = Exo/d^l^(x(s))ds 

< -AEx„ /o V{^{s))ds = -A /o*Exol^(x(s))ds 

Applying the Gronwall's lemma to the deterministic real- valued function 
t ^ E^,V{x{t)) yields 



Vt > Ex„y(x(t)) < y(xo)e- 



-At 



If we assume furthermore that ExQl^(x(t)) < 00 for all t, then the above 
implies that V{x(t)) is a supermartingale (see lemma [3] in the Appendix for 
details), which yields, by the supermartingale inequality 

r„(.u,vi.m>A]<_?^W^Y^ ,..3, 

\T<t<oo J 

Thus, one obtains an almost-sure stability result, in the sense that 

V^>0 lim I sup y(x(t))>A)=0 (2.4) 

T->oo \T<t<oo J 

2.2 The stochastic contraction theorem 
2.2.1 Settings 

Consider a noisy system described by an Ito stochastic differential equation 

da = {{si,t)dt + a{a,t)dW'^ (2.5) 

where f is a M" x M+ ^ M" function, is a M" x M+ ^ W"^ matrix-valued 
function and is a standard d-dimensional Wiener process. 

To ensure existence and uniqueness of solutions to equation (12. 5p . we 
assume, here and in the remainder of the paper, the following standard 
conditions on f and a 

Lipschitz condition: There exists a constant Ki > such that 

Vt>0, a,bGM" ||f(a,t) - f(b,t)| + ||cj(a,t) - o-(b,t)|| <ii:i||a-b|| 

Restriction on growth: There exists a constant K2 > 

Vt>0, aGM" ||f(a,t)f + ||CT(a,f)f < i^2(l + ||af ) 

Under these conditions, one can show ([3], p. 105) that equation (j2.5|) 
has on [0, cxd[ a unique M"-valued solution a(t), continuous with probability 
one, and satisfying the initial condition a(0) = ap, with ao G M". 
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In order to investigate the incremental stability properties of system (I2.5p . 
consider now two system trajectories a{t) and b(t). Our goal will consist of 
studying the trajectories a(t) and h{t) with respect to each other. For this, 
we consider the augmented system x(f) = (a(t), b(t))-^, which follows the 
equation 

= f(x,t)(it + 5(x,f)dVF2d (2.6) 



Important remark As stated in the introduction, the systems a and 
b are driven by distinct and independent Wiener processes Wf and W^. 
This makes our approach considerably different from [5j, where the authors 
studied two trajectories driven by the same Wiener process. 

Our approach enables us to study the stability of the system with respect 
to variations in initial conditions and to random perturbations: indeed, two 
trajectories of any real- life system are typically affected by distinct "real- 
izations" of the noise. In addition, it leads very naturally to nice results on 
the comparison of noisy and noise- free trajectories (cf. section [2^ . which 
are particularly useful in applications (cf . section |3|) . 

However, because of the very fact that the two trajectories are driven 
by distinct Wiener processes, we cannot expect the influence of the noise 
to vanish when the two trajectories get very close to each other. This con- 
strasts with 0], and more generally, with the standard stochastic stability 
case, where the noise vanishes near the origin (cf. section P2.1.2p . The con- 
sequences of this will be discussed in detail in section 12.3.21 



2.2.2 The basic stochastic contraction theorem 

We introduce two hypotheses 

(HI) f(a, t) is contracting in the identity metric, with contraction rate A, 
(i.e. Va,t Amax(||)<-A) 

(H2) tr ((T(a, t)^a{a., t)) is uniformly upper-bounded by a constant C (i.e. 
Va, t tr (o-(a, t)^cj(a, t)) < C) 

In other words, (HI) says that the noise-free system is contracting, while 
(H2) says that the variance of the noise is upper-bounded by a constant. 

Definition 1 A system that verifies (HI) and (H2) is said to be stochas- 
tically contracting in the identity metric, with rate A and bound C . 

Consider now the Lyapunov- like function y(x) = ||a— b|p = (a— b)-^(a— 
b). Using (HI) and (H2), we derive below an inequality on yiy(x), similar 
to equation (j2.2p in section I2.1.2[ 
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Lemma 1 Under (HI) and (H2), one has the inequality 

If(x) < -2Ay(x) + 2C (2.7) 

Proof Since x(t)is an Ito process, A is given by the differential operator 
^ of the process [23 . 0]. Thus, by the Ito formula 



AVi^)=^V{^) = ^^f(x,t) + ltrf5(x,t)^^^^?(x,t) 

ax 2 \ ax^ 

l<i<2n i<i,j,k<2n 
l<t<n l<j<?i 

1< j j,fc<n 

1< j j,fc<n 



2(a-b)^(f(a,t)-f(b,t)) 

+tr((T(a, t)'^cr(a, t)) + tr(o-(b, t)'^a{h, t)) 



Fix t > and, as in [10], consider the real- valued function 

r(^) = (a - b)^(f (^a + (1 - ^)b, t) - f (b, t)) 

Since f is C^, r is over [0, 1]. By the mean value theorem, there exists 
Ho G]0, 1[ such that 

r'ifio) = r(l) - r(0) = (a - b)^(f(a) - f(6)) 

On the other hand, one obtains by differentiating r 

r'ifio) = (a - b)^ (|^(Aioa + (1 - ^o)b, t)^ (a - b) 

Thus, one has 

(a-b)^(f(a)-f(b)) = (a-b)^(^|^(/.oa+(l-Mo)b,t))(a-b) 

< -A(a-b)^(a-b) = -2Ay(x) (2.8) 
where the inequality is obtained by using (HI). 
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Finally, 

AV{x) = 2{si-hf{f{si)-{{h)) + tTia{a,tfa{ai,t))+tT{a{h,tfa{h,t)) 
< -2AT/(x) + 2C 

where the inequality is obtained by using (H2). □ 

We are now in a position to prove our main theorem on stochastic incre- 
mental stability. 

Theorem 2 (Stochastic contraction) Assume that system ^2.5\) verifies 
(HI) and (H2). Let a(t) and b(t) be two trajectories whose initial condi- 
tions are given by a probability distribution p{x{0)) = p(a(0), b(0)). Then 



yt>0 E(||a(i)-b(t)f) < ^ + e-2^*y" 



|ao - bo I 



C 



where [■]~^ = max(0, •). This implies in particular 

Vt > E (||a(t) - h{t)f) < y + E (||a(0) - b(0)f ) e 



dp(ao,bo) 
(2.9) 



-2 At 



(2.10) 



Proof Let xq = (ao,bo) G 



p2n 



By Dynkin's formula ([22], p. 10) 



Exol/(x(t)) -y(xo) =Exo 
Thus one has Vn, t < u < t < oo 



E^,ViKit))-E^,Vixiu)) 



E 



AV{x{s))ds 



AV{x{s))ds 



< Exo /" {-2XV{jc{s)) + 2C)ds (2.11) 

J u 

-2AExo"l^(x(s)) + 2C)cis 



where inequality ()2.1ip is obtained by using lemma [H 

Denote by g{t) the deterministic quantity ExQl^(x(f)). Clearly, g{t) is a 
continuous function of t since x(t) is a continuous process. The function g 
then satisfies the conditions of the Gronwall-type lemma 0] in the Appendix, 
and as a consequence 



vt>o Ex„y(x(t)) < ^ + 



-2 AT 



Litegrating the above inequality with respect to xq yields the desired 
result ()2.9p . Next, inequality ()2.10p follows from (j2.9p by remarking that 



|ao 



bof 



C 



dp(ao,bo) < y ||ao - bo|pdp(ao,bo) 

= E(||a(0)-b(0)f) (2.12) 
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□ 



Remark Let e > and = ^ log ^.^JM^^oEl^ . Then inequal- 



ity (|2.10p and Jensen's inequality [30[| imply 



Vt>r, E(||a(f) -b(t)ll) < y^C/X + e (2.13) 

Since ||a(t) — b(t)|| is non-negative, ()2.13p together with Markov inequal- 
ity ll[ allow one to obtain the following probabilistic bound on the distance 



between a{t) and b(i) 



v^>ovt>r, p(||a(t) -b(t)|| >A)< y^£I^dLl 

Note however that this bound is much weaker than the asymptotic 
almost-sure bound ()2.4I) . 

2.2.3 Generalization to time-varying metrics 

Theorem [2] can be vastly generalized by considering general time-dependent 
metrics (the case of state-dependent metrics is not considered in this article 
and will be the subject of a future work). Specifically, let us replace (HI) 
and (H2) by the following hypotheses 

(HI') There exists a uniformly positive definite metric M(t) = 0(t)'^0(t), 
with the lower-bound /3 > (i.e. Vx,t x'^M(t)x > /3||x|p) and f(a,t) 
is contracting in that metric, with contraction rate A, i.e. 



A ma 

or equivalently 



^&(t) + 0(t)-^ ) 0"^*) ) < -A uniformly 
at oai J J 



^(t)— + I 7^ ) M(t) + — M(t) < -2AM(t) uniformly 
oa \oa J at 

(H2') tr [a{a, t)^M(t)(T(a, t)) is uniformly upper-bounded by a constant C 

Definition 2 A system that verifies (HI') and (H2') is said to be stochas- 
tically contracting in the metric M(t), with rate A and bound C . 

Consider now the generalized Lyapunov-like function Vi(x, t) = (a — 
b)'^M(t)(a- b). Lemma □ can then be generalized as follows. 

Lemma 2 Under (HI') and (H2'), one has the inequality 

1^1 (x,t) < -2Ayi(x,t) + 2C7 (2.14) 



8 



Proof Let us compute first AVi 



AV^{^,t) = ^ + ^f(x,t) + -trU(x,tf ^a(x,t) 



= (a - b)^ (^^M(t) j (a - b) + 2(a - b)^M(t)(f (a, t) - f (b, t)) 

+tr(cr(a, t)^M(t)cj(a, t)) + tr(cj(b, t)^M(t)(T(b, t)) 

Fix t > and consider the real-valued function 

r{fi) = (a - b)^M(i)(f (A^a + (1 - ^)b, t) - f (b, t)) 

Since f is C^, r is over [0, 1]. By the mean value theorem, there exists 
^0 £]0, 1[ such that 

r'ifio) = r(l) - r(0) = (a - b)^M(t)(f (a) - f (b)) 

On the other hand, one obtains by differentiating r 

r'ifio) = (a - hfMit) (|^(/^oa + (1 - Mo)b, t)^ (a - b) 

Thus, letting c = fi^a. + (1 — /^o)t), one has 

(a - b)^ (^M(t)) (a - b) + 2(a - b)^M(t)(f(a) - f(b)) 
= (a - b)^ (|M(t)) (a - b) + 2(a - b)^M(t) (f (c, t)) (a - b) 
= (a - b)^ (|M(t) + M(t) (||(c, t)) + (f(c, t)fMit)) (a - b) 

< -2A(a - b)^M(t)(a - b) = -2Ayi(x) (2.15) 

where the inequality is obtained by using (HI'). 

Finally, combining equation (|2.15p with (H2') allows to obtain the de- 
sired result. □ 

We can now state the generalized stochastic contraction theorem 

Theorem 3 (Generalized stochastic contraction) Assume that system 
i2. 5\) verifies (HI') and (H2'). Let a{t) andh{t) be two trajectories whose 
initial conditions are given by a probability distribution p{x(0)) = p(a(0), b(0)). 
Then 



A 

In particular, 



Vt > E ((a(t) - b(t))^M(t)(a(t) - h{t))) < 

dp(ao,bo) (2.16) 



(ao - bo)^M(0)(ao - bo) - y 



W>0 E(||a(t)-b(t)f)<i(^ + E(||a(0)-b(0)f)e-2^*) (2.17) 
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Proof Following the same reasoning as in the proof of theorem [21 one 
obtains 



Vt>0 ExoFi(x(t)) < ^ + 



X 



-2Xt 



which leads to p. 160 by integrating with respect to (ao, bo). Next, observing 
that 

Mt) - h{t)f < i(a(t) - b(0)^M(t)(a(t) - b(t)) = ^EV^{^{t)) 
and using the same bounding as in ()2.12p lead to ()2.17p . □ 



2.3 Strength of the stochastic contraction theorem 

2.3.1 "Optimality" of the mean square bound 

Consider the following linear dynamical system, known as the Ornstein- 
Uhlenbeck (colored noise) process 



da 



-Xadt + adW 



(2.18) 



Clearly, the noise-free system is contracting with rate A and the trace of 
the noise matrix is upper-bounded by cr^. Let a{t) and b{t) be two system 
trajectories starting respectively at ao and 6o (deterministic initial condi- 
tions). Then by theorem El we have 



> E ((a(t) - b{t)f) < ^ + 

A 



(ao - ho) - — 



(2.19) 



Let us verify this result by solving directly equation ()2.18p . The solution 
of equation (ITTH]1 is ([3], p. 134) 

ft 



a{t) = ttQC 



(2.20) 







Next, let us compute the mean square distance between the two trajec- 
tories a{t) and h{t) 

E((a(t)-6(t))2) = (ao-6o)V2^* + 



E 



(ao - 6o) e: 

2 







-^^* + ^(l-e 
A 



-fe 



gA(n-t)^^2(u) 







(ao - 6o)' 



o 

T 



-2Xt 



The last inequality is in fact an equality when (ao — ^o)^ ^ X' Thus, 
this calculation shows that the upper-bound ()2.19p given by theorem [2| is 
optimal, in the sense that it can be attained. 
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2.3.2 No asymptotic almost-sure stability 



From the explicit form (I2.20p of the solutions, one can deduce that the 

distributions of a{t) and b{t) converge to the normal distribution ^ ^0, 

(3, p. 135). Since a{t) and b{t) are independent, the distribution of the 

difference a{t)—b(t) will then converge to ^ (o, . This observation shows 

that, contrary to the case of standard stochastic stability (cf. section [2.1.2p . 
one cannot - in general - obtain asymptotic almost-sure incremental stability 
results (which would imply that the distribution of the difference converges 
instead to the constant 0). 

Compare indeed equations (12. 2p (the condition for standard stability, sec- 
tion [2TL2]) and p.7p (the condition for incremental stability, section r2.2.2p . 
The difference lies in the term 2C, which stems from the fact that the influ- 
ence of the noise does not vanish when two trajectories get very close to each 
other (cf. section 2. ip . The presence of this extra term prevents AV{x{t)) 
from being always non-positive, and as a result, it prevents V{x(t)) from be- 
ing always "non-increasing". As a consequence, V{x(t)) is not - in general - 
a supermartingale, and one cannot then use the supermartingale inequality 
to obtain asymptotic almost-sure bounds, as in equation (j2.3p . 



Remark If one is interested in finite time bounds then the supermartin- 
gale inequality is still applicable, see ([^l], p. 86) for details. 

2.4 Noisy and noise-free trajectories 

Consider the following augmented system 

( J(b,') ) + ( .(It) ){Zj) ='f(x.*)<'t + S(x, 

(2.21) 

This equation is the same as equation (|2.6p except that the a-system is 
not perturbed by noise. Thus V{x) = ||a — bp will represent the distance 
between a noise-free trajectory and a noisy one. All the calculations will be 
the same as in the previous development, with C being replaced by C/2. 
One can then derive the following corollary 

Corollary 1 Assume that system 12. 5\) verifies (HI') and (H2'). Let a{t) 
be a noise-free trajectory starting at ao and b(t) a noisy trajectory whose 
initial condition is given by a probability distribution p(h{0)). Then 




(2.22) 
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Remarks 



• One can note here that the derivation of corohary [T] is only permitted 
by our initial choice of considering distinct driving Wiener process for 
the a- and b-systems (cf . section I2.2.ip . 

• Corollary [T] provides a robustness result for contracting systems, in the 
sense that any contracting system is automatically protected against 
noise, as quantified by ()2.22p . This robustness could be related to the 
exponential nature of contraction stability. 

3 Combinations of contracting stochastic systems 

Stochastic contraction inherits naturally from deterministic contraction [3] 
its convenient combination properties. Because contraction is a state-space 
concept, such properties can be expressed in more general forms than input- 
output analogues such as passivity-based combinations [29]. The following 
combination properties allow one to build by recursion stochastically con- 
tracting systems of arbitrary size. 

Parallel combination Consider two stochastic systems of the same di- 
mension 

J dxi = fi (xi ,t)dt + ai (xi , t)dWi 
\ dx2 = i2{x2, t)dt + a2ix2,t)dW2 

Assume that both systems are stochastically contracting in the same 
constant metric M, with rates Ai and A2 and with bounds Ci and C2. 
Consider a uniformly positive bounded superposition 

ai(t)xi + a2(t)x2 

where Vt > 0, k < ai{t) < rrii for some /j, rrij > 0, i = 1, 2. 

Clearly, this superposition is stochastically contracting in the metric M, 
with rate liXi + /2A2 and bound miCi + m2C2- 

Negative feedback combination In this and the following paragraphs, 
we describe combinations properties for contracting systems in constant met- 
rics M. The case of time- varying metrics can be easily adapted from this 
development but is skipped here for the sake of clarity. 
Consider two coupled stochastic systems 

J dxi = fi(xi, X2, + cri(xi, 

\ dx2 = f2(xi,X2,t)(it + cr2(x2,t)dl^2 

Assume that system i (i = 1, 2) is stochastically contracting with respect to 
Mj = @J@i, with rate Aj and bound Cj. 



12 



Assume furthermore that the two systems are connected by negative 



feedback 33|] . More precisely, the Jacobian matrices of the couphngs are of 
the form 0iJi202 ^ ~ — A:02J2i®r^' with k a positive constant. Hence, 
the Jacobian matrix of the augmented system is given by 

Jl -k@^^@2J^^G^^&2 
J2I J2 

Consider a coordinate transform = I " ^ rr^ \ associated with 



Vk&2 

the metric M = 0^0 > 0. After some calculations, one has 



< max(— Ai, — A2)I uniformly (3-1) 

The augmented system is thus stochastically contracting in the metric 
M, with rate min(Ai, A2) and bound Ci + kC2- 

Hierarchical combination We first recall a standard result in matrix 

Ai A^ 

analysis Let A be a symmetric matrix in the form A — ' 



A21 A2 

Assume that Ai and A2 are definite positive. Then A is definite positive if 
sing^(A2i) < Amin(Ai)Amin(A2) where sing(A2i) denotes the largest singu- 
lar value of A21. In this case, the smallest eigenvalue of A satisfies 




Amm(Ai) + Amm(A2) / / Amin(Ai) — Amm(A2) ^ ^ 



mm(A) > W + Smg^(A2l 



Consider now the same set-up as in the previous paragraph, except that 
the connection is now hierarchical and upper-bounded. More precisely, the 
Jacobians of the couplings verify J12 = and sing 

2(02J2i0r^) < K. The 
Jl 



Jacobian matrix of the augmented system is then given by J 



J21 J2 



Consider a coordinate transform 0^ = ( ^ ) associated with the 



£02 

metric = 0^0^ > 0. After some calculations, one has 

[OJO )^ - ^l^Q^j^^Q-l (e2J202^), J 

Set now e — \/ ^^j^^ . The augmented system is then stochastically con- 



tracting in the metric M^, with rate ^(Ai + A2 — a/A^-|-A|)) and bound 

!Al 

K 



2C2A1A2 
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Small gains In this paragraph, we require no specific assumption on the 

form of the couplings. Consider the coordinate transform = ( /-^ 

\^ Vk&2 

associated with the metric = 0^0^ > 0. Aftersome calculations, one 
has 



Bfc (02J202') 



where Bfc = i (^Vk@232i&i^ + ^ (0iJi202 ^) 

Following the matrix analysis result stated at the beginning of the pre- 
vious paragraph, if inf^^o sing^(Bfc) < A1A2 then the augmented system is 
stochastically contracting in the metric M^, with bound Ci + kC2 and rate 
A verifying 




2 



A>^^-l/(^^) +inf-ng2(B.) (3-2) 



4 Some examples 

4.1 Effect of measurement noise on contracting observers 

Consider a nonlinear dynamical system 

i = f(x,t) (4.1) 

If a measurement y = y (x) is available, then it may be possible to choose 
an output injection matrix K(t) such that the dynamics 

i = f(x,t) + K(t)(y-y) (4.2) 

is contracting, with y = y(x). Since the actual state x is a particular 
solution of (14. 2p . any solution x of (14. 2|] will then converge towards x expo- 
nentially. 

Assume now that the measurements are corrupted by additive "white 
noise". In the case of linear measurement, the measurement equation be- 
comes y = H(t)x + S(t)^(t) where ^(t) is a multidimensional "white noise" 
and S(t) is the matrix of measurement noise intensities. 

The observer equation is now given by the following Ito stochastic dif- 
ferential equation (using the formal rule dW = S,dt) 

= (f (x, t) + K(i)(H(i)x - U{t)^))dt + K{t)J:{t)dW (4.3) 
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Next, remark that the solution x of system ()4.ip is a also a solution of 
the noise- free version of system ()4.3p . By corollary [H one then has, for any 
solution X of system ()4.3p 



where 



Vi>0 E(||x(t) -x(t)f 

'9f(x,t 



<^ + ||xo-xo||V2^* (4.4) 



A = inf 



K(t)H(t) 



C = suptr (S(t)^K(t)^K(t)S(t)) 



Remark The choice of the injection gain K(t) is governed by a trade- 
off between convergence speed (A) and noise sensitivity (C/X) as quantified 
by (14. 4p . More generally, the explicit computation of the bound on the 
expected quadratic estimation error given by ()4.4|) may open the possibility 
of measurement selection in a way similar to the linear case. If several 
possible measurements or sets of measurements can be performed, one may 
try at each instant (or at each step, in a discrete version) to select the 
most relevant, i.e., the measurement or set of measurements which will best 
contributj3 to improving the state estimate. Similarly to the Kalman filters 
used in [qI for linear systems, this can be achieved by computing, along 
with the state estimate itself, the corresponding bounds on the expected 
quadratic estimation error, and then selecting accordingly the measurement 
which will minimize it. 



4.2 Estimation of velocity using composite variables 

In this section, we present a very simple example that hopefully suggests the 
many possibilities that could stem from the combination of our stochastic 
stability analysis with the composite variables framework [s]]]. 

Let X be the position of a mobile subject to a sinusoidal forcing 

X = -Uiu? sin(L^t) + 2U2 

where Ui and oj are known parameters. We would like to compute good 
approximations of the mobile's velocity v and acceleration a using only mea- 
surements of X and without using any filter. For this, construct the following 
observer 

— f'" \ = ( ^ \ ( \ + ( ^ 

dt \ a J y —OLa J \ a J \ —aaa^x — UiU)^ cos{u!t) J 

= Af ^Uef ^ Vf 3V (4.5) 

\ a J \ ^ J V Uiuj-^ cos[iot) J ^ ' 
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and introduce the composite variables v = v + a^x and a = a + OaX. By 
construction, these variables follow the equation 



d / V 
dt \ a 



V — V 

a 



+ 





-Uiuj'^ cos(wt) 



(4.6) 



and therefore, a particular solution of (v,a) is clearly {v,a). Choose now 

= a.d let M„ = i f "\ -'f\ One can then show that 

^ y —a/2 1 J 

system (|4.6|) is contracting with rate = a/2 in the metric Mq,. Thus, by 
the basic contraction theorem {v,a) converges exponentially to {v,a) 
with rate Aq, in the metric Mq,. Also note that the /3-bound corresponding 
to the metric is given by /?„ = iW-Va^-a^ +i^ 

Next, assume that the measurements of x are corrupted by additive 
"white noise", so that Xmeasured = X + a^. Equation (14. 5p then becomes an 
Ito stochastic differential equation 



d 



- I+B 

a 





UiLO'^ cos{ujt) 



dt+B 



a 
a 



dW 



By definition of B, the variance of the noise in the metric Mq, is upper- 
bounded by ^y-. Thus, using again corollary [H one obtains (see Figured] 
for a numerical simulation) 



Vi > E {\mt) - v{t)f + \\a{t) - a{t)f) < 



a^a"^ \\vo — vqW^ + \\aQ — aoW^ 



■ + - 



4.3 Stochastic synchronization 

Consider a network of n dynamical elements coupled through diffusive con- 
nections 



dxj = j f (xj, t) + ^ Kij(xj - Xi) j dt + ai{xi,t)dWf i = l,...,n 



X 



Let 



/ f(xi,t) 



f(S,t) 



/ cTi(xi,t) 



, a(x,i) 



V f(xn,t) 

The global state x then follows the equation 

dx = (x, t) - Lxj dt + a(x, t)dW 



nd 



(4.7) 



\ C7n(x„,t) 



(4.8) 
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Figure 1: Estimation of the velocity of a mobile using noisy measurements 
of its position. The simulation was performed using the Euler-Maruyama 
algorithm [18(] with the following parameters: Ui = 10, U2 = 2, iv = 3, 
£7 = 10 and a = 1. Left plot: simulation for one trial. The plot shows 
the measured position (red), the actual velocity (blue) and the estimate of 
the velocity using the measured position (green). Right plot: the average 



over 1000 trials of the squared error 
asymptotic bound 



+ ||a — a|| (green) and the 



2/3q 



200 ) given by our approach (red) . 



In the sequel, we follow the reasoning of [2g], which starts by defining an 
appropriate orthonormal matrix V describing the synchronization subspace 
(V represents the state projection on the subspace TW"*", orthogonal to the 
synchronization subspace ^A = {(xi, . . . ,Xn)^ : xi = . . . = x„}, see [2^ for 
details). Denote by y the state of the projected system, y = Vx. Since the 
mapping is linear, Ito differentiation rule simply yields 

dy = VdS = (Vf (S, t) - VLX) dt + V5(S, i)(iVF"'^ 

fvf (V^y, t) - VLV^y) dt + V?(V^y, t)dW'^'^ (4.9) 



Assume now that ^ is uniformly upper-bounded. Then for strong 
enough coupling strength, A = V^V"^ — VLV^ will be uniformly neg- 
ative definite. Let A = |Amax(A)| > 0. System ()4.9p then verifies condition 
(HI) with rate A. Assume furthermore that each noise intensity o"j is upper- 
bounded by a constant Cj (i.e. sup^ ^ tr(cjj(x, t)-^crj(x, t)) < Cj). Condition 
(H2) will then be satisfied with the bound C = Y^- Ci. 

Next, consider a noise-free trajectory yuit) of system (14. 9|) . By theo- 
rem 3 of [3], we know that y«(i) converges exponentially to zero. Thus, 
by corollary [U one can conclude that, after exponential transients of rate A, 

On the other hand, one can show that 
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n 
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Thus, after exponential transients of rate A, we have 



1,9 I^C 

X,- < ^ 
^" - 2A 



Remarks 

• The above development is fully compatible with the concurrent syn- 



chronization framework 28|]. It can also be easily generalized to the 



case of time- varying metrics by combining theorem [3] of this paper and 



corollary 1 of [28(] 



• The synchronization of Ito dynamical systems has been investigated 
in However, the systems considered by the authors of that article 
were dissipative. Here, we make a less restrictive assumption, namely, 
we only require ^ to be uniformly upper-bounded. This enables us 
to study the synchronization of a broader class of dynamical systems, 
which can include nonlinear oscillators or even chaotic systems. 

Example As illustration of the above development, we provide here a de- 
tailed analysis for the synchronization of noisy FitzHugh-Nagumo oscillators 



(see [35| for the references). The dynamics of two diffusively-coupled noisy 



FitzHugh-Nagumo oscillators can be described by 

dvi = {c{vi + Wi- ^vf + li) + k{vQ - Vi))dt + adWi = i 2 
dwi = —\{vi — a + bwi)dt ' 

Let X = {vi,wi,V2,W2)'^ and V = ^^J ^ ^ -l)' '^^^ J^'^o- 
bian matrix of the projected noise- free system is then given by 



c 2 



g("l+"2) _ ^ g 

1/c -b/c 



Thus, if the coupling strength verifies k > c then the projected system 
will be stochastically contracting in the diagonal metric M = diag(l, c) with 
rate min(A; — c,b/c) and bound cr^. Hence, the average absolute difference 
between the two "membrane potentials" |f 1 — t;2| will be upper-bounded by 
C7/Y^min(l, c) m\n{k — c, b/c) (see Figure [2] for a numerical simulation). 

Acknowledgments We are grateful to Dr S. Darses, Prof D. Bennequin 
and Prof M. Yor for stimulating discussions, and to the Associate Editor 
and the reviewers for their helpful comments. 
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Figure 2: Synchronization of two noisy FitzHugh-Nagumo oscillators. The 
simulation was performed using the Euler-Maruyama algorithm [l^ with 
the following parameters: a = 0.3, b = 0.2, c = 30, /c = 40 and a = 1. The 
plot shows the "membrane potentials" of the two oscillators. 



A Appendix 

A.l Proof of the supermartingale property 

Lemma 3 Consider a Markov stochastic process x{t) and a non-negative 
function V such that \/t > KV{x{t)) < oo and 

Vx G M" Iy(x) < -Ay(x) (A.l) 

where X is a non-negative real number and A is the infinitesimal operator 
of the process x(t). Then V{x{t)) is a supermartingale with respect to the 
canonical filtration = s < t}. 

We need to show that for all s > t, one has E(F(x(s))|^t) < V{x{t)). 
Since x(t) is a Markov process, it suffices to show that 

Vxo e M" E(y(x(t))|x(0) = xo) < V{xo) 

By Dynkin's formula, one has for all xq € M" 

ExoF(x(t)) = V{xo)+E^,f^AV{x{s))ds 

< y(xo) - AExo /o Vix{s))ds < F(xo) 

where Exo(-) = E(-|x(0) = xq). 

A. 2 A variation of Gronwall's lemma 

Lemma 4 Let g : [0,oo[-^ R be a continuous function, C a real number 
and A a strictly positive real number. Assume that 

Mu,t 0<u<t g{t) - g{u) < I -\g{s) + Cds (A.2) 



19 



Then 

r-< r r^i + 

-At 



(J 

Vt > g{t) <Y + 
A 



m - f 



e"^* (A.3) 



where = max(0, • 



Proof Case 1 : C = 0, ^(0) > 0. 
Define h{t) by 

Vt > = 5(0)e-^* 

Remark that h is positive with h(0) = g{0), and satisfies ()A.2j) where the 
inequality has been replaced by an equality 

yu,t 0<u<t h{t) - h{u) = - I \h{s)ds 

J u 

Consider now the set S" = > | g{t) > h{t)]. If 5 = then the 
lemma holds true. Assume by contradiction that 5 7^ 0. In this case, let 
m = inf S < CO. By continuity of g and h and by the fact that (7(0) = /i(0), 
one has g{m) = h{m) and there exists e > such that 

Vte]m,m + e[ g{t) > h{t) (A.4) 

Consider now 4){t) = g{m) — \ J^g{s)ds. Equation ()A.2p implies that 

yt>m g{t) < 4>{t) 

In order to compare (j){t) and h[t) for t G]m, m + e[, let us differentiate the 
ratio (p{t)/h{t). 

_ (t)'h - h'(t> _ -Xgh + Xhcj) _ \h{4> - ff) > q 



hj /i2 /i2 /i2 

Thus (l){t)/h{t) is increasing for t G]m,m + e[. Since (j){m)/h{m) = 1, one 
can conclude that 

Mte]m,m + e[ 4>{t)>h{t) 
which implies, by definition of (p and /i, that 



E]m,m + e[ j g{s)ds < j h{s)ds (A.5) 

Jm J in 



Choose now such that m < < m + then one has by ()A.4p 

to /"to 
g{s)ds > I h{s)ds 



which clearly contradicts (lA.Sp . 
Case 2 : C = 0, c/(0) < 
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Consider the set 5" = {t > | g{t) > 0}. If S" = then the lemma holds 
true. Assume by contradiction that S 7^ 0. In this case, let m = inf S < 00. 
By continuity of g and by the fact that g{0) < 0, one has g{m) = and 
there exists e such that 

VtG]m,m + e[ ^(t) > (A.6) 
Let to &]m,m + e[. Equation (|A.2p implies that 

g{to) < -A / g{s)ds 



which clearly contradicts (lA.6p . 
Case 3 : C / 
Define g = g — C / X. One has 

Vn,i 0<n<t g{t)-g{u) = g{t)-g{u) < f -Xg{s)+Cds = - f Xg{s)ds 

J u J u 

Thus g satisfies the conditions of Case 1 or Case 2, and as a consequence 



Vt > g{t) < [5(0)]+e- 



-xt 



The conclusion of the lemma follows by replacing g hy g — C/X in the above 
equation. □ 
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